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Abstract. We prove an abstract instability result for an eigenvalue problem with param- 
eter. We apply this criterion to show the transverse linear instability of solitary waves on 
various examples from mathematical physics. 

1. Introduction 
We shall study a generalized eigenvalue problem under the form 

(1.1) aA(k)U = L(k)U 

where L(k), A(k) are operators (possibly unbounded) which depend smoothly on the real 
parameter k on some Hilbert space H with moreover L(k) symmetric. Our aim is to give an 
elementary criterion which ensures the existence of o > and k ^ such that fll.lj) has a 
nontrivial solution U. Our motivation for this problem is the study of transverse instability 
of solitary waves in Hamiltonian partial differential equations. Indeed, let us consider a 
formally Hamiltonian PDE, say in M 2 , under the form 

(1.2) d t U = JVH(U), J* = -J 

and assume that there is a critical point of the Hamiltonian (hence a stationary solution) 
U(x, y) = Q(x) which depends only on one variable. Note that many equations of mathe- 
matical physics have one- dimensional solitary waves solutions which can be seen as critical 
points of a modified Hamiltonian after a suitable change of frame. We shall consider a few 
examples below. An interesting question is the stability of the one-dimensional state when it 
is submitted to general two-dimensional perturbations. There are many examples where the 
one-dimensional state even if it is stable when submitted to one-dimensional perturbations is 
destabilized by transverse oscillations, we refer for example to [21], PQ, [16]. In our previous 
works [21], [22], [23], we have developed a framework which allows to pass from spectral 
instability to nonlinear instability. The aim of this note is to state a general criterion which 
allows to get spectral instability. Note that the linearization of (11.21) about Q reads 

(1.3) d t V = JCV 

where £ = WH(Q) is a symmetric operator. Since Q does not depend on the transverse 
variable y, if J and H are invariant by translations in y, we can look for a solution of (11.31) 
under the form 

(1.4) V(t,x,y) = e at e iky U(x). 
This yields an eigenvalue problem for U under the form 

(1.5) aU=(JM)(k)U 
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where M(k), J(k) defined by 



M(k)U = e- ikv C(e iky U), J(k)U = e~ iky J(e lky U) 

are operators acting only in the x variable. Consequently, if J(k) is invertible, we can set 
the problem under the form ( 11. II) with A(k) = J{k)~ 1 . As we shall see on the examples, 
it may happen that the skew symmetric operator J(k) (which very often does not depend 
on k) is not invertible. In these cases, we can also recast the problem under the form (II. ip . 
For example, we can look for solutions of ( II. 5p under the form U = J(k)*V and thus get a 
problem under the form (O) with A(k) = J{k)*, L(k) = J(k)M(k)J(k)*. 

For the sake of simplicity, we shall work within a real framework but our result can be easily 
generalized to complex Hilbert spaces. We shall also study ( II. ip only for k > 0. A similar 
instability criterion for k < can be obtained by setting A{k) = A(—k), L{k) = L(—k) and 
by studying the problem ( II. ip for A and L. 

Let us fix the functional framework. We consider a (real) Hilbert space H with scalar 
product (•,•)• We assume that L(k) is a self-adjoint unbounded operator with domain T> 
continuously imbedded in H and independent of the real parameter k. Moreover, L(k) as 
an operator from T> to H is assumed to depend smoothly on k. Finally, we also assume that 
A{k) G C(V,H) and depends smoothly on k. A C 1 dependence is actually sufficient for our 
purpose. 

Our aim here is to present a criterion which allows to prove transverse instability in solitary 
waves stability problems. This amounts to prove the existence of a nontrivial solution of 
( II. ip with k 7^ and a with positive real part. In solitary wave stability problem, is very 
often (when the problem is translation invariant in x) an eigenvalue of L(0) with eigenvector 
Q' . Consequently, since we know that ( II. ip has a nontrivial solution for a — 0, k — 0, 
we can look for a solution (a, U, k) of ( II .ip in the vicinity of this particular solution. The 
main difficulty to implement this strategy is that also very often in solitary waves stability 
problems, is in the essential spectrum of JM(0), therefore the standard Lyapounov-Schmidt 
reduction cannot be used. One way to solve this problem is to introduce an Evans function 
with parameter D(a,k) (we refer for example to [2], [9], [20], [33] for the definition of the 
Evans function) for the operator JM(k) and then to study the zeroes of D in the vicinity 
of (0, 0) (after having proven that D has in a suitable sense a smooth continuation in the 
vicinity of (0,0)). We refer for example to [6], [3], [25] for the study of various examples. 
Let us also mention [8], [19], [12], for other approaches, where the eigenvalue problem is not 
reformulated as an ODE with parameters. 

Here we shall present a simple approach which relies only on the properties of L(k) which 
are rather easy to check (mostly since it is a self-adjoint operator) and does not rely in 
principle on the reformulation of the problem as an ODE. 

Our main assumptions are the following: 

(HI) There exists K > and a > such that L(k) > aid for \k\ > K; 
(H2) The essential spectrum Sp ess (L(k)) of L{k) is included in [ck, +oo) with Ck > for 
k^0; 

(H3) For every ki > /c 2 > 0, we have L(k\) > L(k2). In addition, if for some k > and 
U ^ 0, we have L(k)U = 0, then (L'(k)U, U) > (with L'(k) the derivative of L with 
respect to k); 
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(H4) The spectrum Sp(L(0)) of L(0) is under the form {—A} U I where —A < is an 
isolated simple eigenvalue and / is included in [0, +00). 

Let us point out that the structure of the spectrum of L(0) assumed in (H4) is one of the 
assumption needed to have the one-dimensional stability of the wave (at least when there is 
a one-dimensional group of invariance in the problem) , we refer to pj] . Note that may be 
embedded in the essential spectrum of L(0). 

Our main result is the following: 
Theorem 1.1. Assuming (Hl-4), there exists a > 0, k ^ and U G X>\{0} solutions of 

Note that we get an instability with a real and positive. Once the spectral instability 
is established, one may use the general framework developed in (22] to prove the nonlinear 
instability of the wave. 

The assumption (H3) is clearly matched if L'(k) is positive for every k > 0. This last 
property is verified for all the examples that we shall discuss in this paper. Moreover if L'(k) 
is positive for k > 0, the proof of Theorem 11.11 can be slightly simplified (see Remark 12.11 
below). 

The paper is organized as follows. In the following section, we shall give the proof of 
Theorem ll.il Next, in order to show how our abstract result can be applied, we shall study 
various examples: the KP-I equation, the Euler-Korteweg system and the Gross-Pitaevskii 
equation. Note that we have already used similar arguments to prove the instability of 
capillary-gravity solitary water-waves in [23] • We hope that our approach can be useful for 
other examples, we also believe that this approach can be adapted to many situations with 
slight modifications. 

2. Proof of Theorem 11.11 

The first step is to prove that there exists ko > such that L(ko) has a one-dimensional 
kernel. 
Let us set 

f(k)= mi(L(k)U,U). 

Note that by (H4) L(0) has a negative eigenvalue, hence we have on the one hand that 
/(0) < 0. On the other hand by assumption (HI), we have that f(k) > for k > K. Since 
/ is continuous, this implies that there exists a minimal k > such that f(k ) = 0. For 
every k < ko, we get that L(k) has a negative eigenvalue (since f(k) is negative and L{k) 
self-adjoint, this is a direct consequence of the variational characterization of the bottom of 
the spectrum and of (H2) which gives that the essential spectrum of L(k) is in (0,+oo)). 
Actually, there is a unique negative simple eigenvalue. Indeed, if we assume that L(k) has 
two (with multiplicity) negative eigenvalues, then L(k) is negative on a two-dimensional 
subspace. By (H3), this yields that L(0) < L{k) is also negative on this two-dimensional 
subspace. This contradicts (H4) which contains that L(0) is nonnegative on a codimension 
one subspace. 

By the choice of ko and (H2), we also have that the kernel of L(ko) is non-trivial. 
To conclude, we first note that if for every k G (0, ko) the kernel of L(k) is trivial, then 
the kernel of L(ko) is exactly one-dimensional. Indeed, let us pick k < k , then, since L{k) 
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has a unique simple negative eigenvalue and a trivial kernel, we get that L(k) is positive on 
a codimension one subspace. Since L(ko) > L(k) by (H3), this implies that the kernel of 
L(ko) is exactly one-dimensional. 

Next, we consider the case that there exists ki G (0, k ) such that L{k\) has a nontrivial 
kernel. Since L(ki) has a unique simple negative eigenvalue, we get that L(ki) is nonnegative 
on a codimension 1 subspace V = (<p) ± = {V G T> : (V, y?) = 0} , ip being an eigenvector 
associated to the negative eigenvalue. Moreover, thanks to (H2), we have an orthogonal 
decomposition of V, 

(2.1) V = Ker L(k x ) ®± V 

with V stable for L{k\) and L{k\) restricted to V coercive. Note that moreover Ker L(ki) is 
of finite dimension. For every U G S where S is the unit sphere of Ker L{k\) i.e. S = {U G 
Ker L(ki), \\U\\ = 1}, we have by (H3) that (L'(ki)U,U) > 0. From the compactness of S, 
we get that Co = miu£s(L'(ki)U, U) is positive. This yields that for every k>k\ close to k\ 
and U in S, 

(L(k)U,U)>^(k-h) 

and hence by homogeneity that 

(2.2) (L(k)U,U) > ^(k-k^WUW 2 , VU G Ker L{k\). 

Now according to the decomposition (12.11) of V, we can write L(k) with the block structure 

L ^> ~ { A*(k) L 2 {k) ) ■ 

By the choice of V, L 2 (ki) is coercive, therefore, there exists a > such that for every k 
close to k\, we have 

(2.3) (L 2 (k)U, U) > a\\U\\ 2 , W G V. 

Moreover, we also have that A{k\) = (since V is a stable subspace for L(k\)). By the 
assumed regularity with respect to k, we thus get that 

(2.4) \\A(k)\\c { V,KerL( kl )) < M \k - h\, Wk G [h/2, 2AJ 
for some M > 0. 

Consequently, by using (I2.2p . (I2.3P and (12. 4p . we get that for every U = (U\, U2) G V and 
every k > k\ close to k±, we have 

(L(k)U,U) > ^(A;-A; 1 )||f/ 1 || 2 + «||f/ 2 || 2 -2M(A;-/e 1 )||f/ 1 || ||f/ 2 ||. 

From the Young inequality, we can write 

2M(fc-fc 1 )||*7i|| \\U 2 \\ < ^WU^Wk - k x ) + M{k - k^WUif 

with M = 4M 2 /cq and hence, we obtain 

{L(k)U, U) > - ^OHf/ill 2 + (a- M(k - hmUzW 2 . 

In particular, we get that for every k > k\ close to k\, L(k) is coercive on V and hence 
positive. Let us take some k < ko with this last property. Since by (H3), L(ko) > L(k), we 
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get that L(ko) is also positive on V which has codimension 1. Therefore the kernel of L(ko) 
is exactly one-dimensional. 

We have thus obtained as claimed that there exists ko > such that L(ko) has a one- 
dimensional kernel. Thanks to (H2), we also have that L(k ) is a Fredholm operator with 
zero index. We can therefore use the Lyapounov-Schmidt method to study the eigenvalue 
problem (II. ip in the vicinity of a = 0, k — ko and U — ip where ip is in the kernel of L(k Q ) 
and such that \\ip\\ = 1. 

We look for U under the form U — tp + V, where 

Veif ± = {V eV : (V» = 0}. 

Therefore we need to solve G(V, k, a) = with a > 0, where 

G(V, k, a) = L(k)<p + L(k)V - aA(k)ip - aA(k)V, V 6 ip 1 . 

We shall use the implicit function theorem to look for V and k as functions of a. Note that 
the same approach is for example used in [12]. We have that 



(2.5) D Vjk G{0,ko,0)[w,n] = (i 4r L ( k ) ¥ + L(k )w. 



dk 



k=ko 



By using (H3), we obtain that Dv,kG(0, ko, 0) is a bijection from ip 1 - x M to H. We can thus 
apply the implicit function theorem to get that for a in a neighborhood of zero there exists 
k(a) and V(a) such that G(V(a), k(a), a) = 0. This ends the proof of Theorem 11.11 

Remark 2.1. Let us remark that if we assume that L'(k) is positive for k > in place 
of (H3), then we can simplify the argument giving a k ^ such that L(ko) has a one- 
dimensional kernel. Namely, in this case by using (H4), we have that L(0) is nonnegative 
on a codimension 1 subspace V (given by V = 7T[o,+oo)(£(0)) HV, where tt[o,+oo)(L(0)) is the 
spectral projection on the nonnegative spectrum of L(0)). Next, using that L'(s) is positive 
for s > 0, we get for every k > that 

(L(k)U,U)= [ (L'(s)U,U)ds+ (L{0)U,U) > 0, VU e V. 
Jo 

Moreover, if (L(k)U, U) = for U G V then the above identity yields 

pk 

/ (L'(s)U,U)ds = 
Jo 

and hence by using again that L'(k) is positive for k > 0, we obtain that U = 0. Consequently, 
we get that for k > 0, L(k) is positive on a codimension 1 subspace. This yields that the 
dimension of the kernel of L(ko) is exactly one. 



3. Examples 

In this section we shall study various physical examples where Theorems 11.11 can be used 
to prove the instability of line solitary waves. 
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3.1. KP-I equation. We shall first see that the instability argument given in [22] can be 
interpreted in the framework of (jl.ip . Let us consider the generalized KP-I equation where 

(3.1) d t u = d x (- d xx u - u p ) + d^dyyU, p = 2, 3, 4 

and u(t,x,y) is real valued. There is an explicit one- dimensional solitary wave (which thus 
solves the generalized KdV equation): 

u(t, x) = Q(x - i) = (^^(sech^ 'P-'f-" ))^. 

Note that in this problem, it suffices to study the stability of the speed one solitary wave 
since the solitary wave with speed c > can be deduced from it by scaling: the solitary wave 
with speed c > is given by 

After changing x into x — t (and keeping the notation x) and linearizing about Q, we can 
seek for solution under the form 

e at e iky V(x) 

to get the equation 

aV = d x ( - d xx - k 2 d~ 2 + 1 - pQ?- 1 ) V. 
We can seek for a solution V under the form V = d x ll to get that U solves 

-ad x U = ( - d x (-d xx + 1 - pQ^R + k 2 ^U. 

Therefore, this eigenvalue problem is under the form (11.11) with 

A(k) = -d x , L(k) = <)J <),..,. + 1 - pQ p ~ l )d x + k 2 . 

By choosing H = L 2 (R) and V = H 4 (R), we are in an appropriate functional framework. 
Note that L(k) has a self-adjoint realization. 

Let us check the assumptions (Hl-4). 

Since we have 

(L(k)U,U) > \\d xx U\\ 2 L2 + k 2 \\U\\ 2 L2 + \\d x U\\ 2 L2 -p\\Q p - 1 \\L»\\d x U\\v 

and that for every 5 > 0, there exists C(5) > such that 

\\d x U\\ 2 L2 <5\\d xx U\\ 2 L2 +C(5)\\U\\ 2 L2 , 

we immediately get that (HI) is verified. 

Next, we note that L(k) is a compact perturbation of 

L 00 (k) = -d x (-d xx + l)d x + k 2 , 

we thus get from the Weyl Lemma and the explicit knowledge of the spectrum of L^ik) that 
the essential spectrum of L(k) is included in [k 2 , +oo) and thus that (H2) is verified. 

Assumption (H3) is obviously verified since L'(k) is positive for every k > 0. 

Finally, let us check (H4). Note that L(0) = —d x Cd x where C is a second order differential 
operator. We notice that CQ' = and that by the same argument as above, the essential 
spectrum of C is contained in [1, +oo). Since Q' vanishes only once, we get by Sturm Liouville 
theory (we refer for example to [7], chapter XIII) that C has a unique negative eigenvalue 
with associated eigenvector ip. Moreover, we also have that 

(3.2) (Cu lU )>0 VttG^) 1 
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After these preliminary remarks, we can get that L(0) has a negative eigenvalue. Indeed by 
an approximation argument, we can construct a sequence u n in D such that d x u n tends to 
-0 in T> then, for n sufficiently large (L(0)u n ,u n ) = (Cd x u n ,d x u n ) is negative. By the varia- 
tional characterization of the lowest eigenvalue, we get that L(0) has a negative eigenvalue. 
Moreover, for every U such that (d x U,ip) = 0, we have that 

{L(0)U,U) = (Cd x U,d x U) >0 

This proves that L(0) is nonnegative on a codimension one subspace and hence that there 
is at most one negative eigenvalue. We have thus proven that (H4) is verified. 

Consequently, we get from Theorem 11.11 that the solitary wave is transversally unstable. 

3.2. Euler-Korteweg models. We consider a general class of models describing the isother- 
mal motion of compressible fluids and taking into account internal capillarity. The main fea- 
ture of these models is that the free energy F depends both on p and Vp. In the isentropic 
case, we have: 

F{ P) V P ) = F Q {p)+ l -K{p)\Vp\ 2 

where Fq( P ) is the standard part and K(p) > is a capillarity coefficient. The pressure 
which is defined by p = p^ — F reads 

P(P, Vp) = Po(p) + \ (pK'(p) - K{p)) | Vp| 2 
The equations of motion read 

(3.3) d t p + V ■ (pu) = 0, 

(3.4) d t u + u-Vu + V(g (p)) = V {K(p)Ap + l -K \p) \ Vp| 2 ) . 

In this model, p > is the density of the fluid and u the velocity, g (which is linked to po 
by pg'o(p) = Po(p)) an d K(p) > are smooth functions of p for p > 0. 

We shall consider a one-dimensional solitary wave of (I3.3p . ( 13. 4p under the form 

(p(t,x,y),u(t,x,y)) = (p c (x - ct),u c (x - ct)) = Q c (x - ct) 

such that 

(3.5) lim Q c = Qoo = (Poo,Moo), Poo > 0. 

IE— >±00 

We shall assume that 

(3.6) Poofi'o(Poo) > (^oo - C) 2 . 

This condition ensures that Qoo is a saddle point in the ordinary differential equations 
satisfied by the profile. Under this condition, one can find solitary waves, moreover, they 
have the interesting property that p' c vanishes only once. We refer for example to [3], for the 
study of the existence of solitary waves for this system. 

Here we shall study the (linear) transverse instability of these solitary waves. We shall 
restrict our study to potential solutions of (13. 3p . (13. 4p that is to say solutions such that 
u = V<p. Note that this will give a better instability result, this means that we are able to 
find instabilities even in the framework of potential solutions. 
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This yields the system 

(3.7) d t p + Vif- Vp + pAtp = 0, 

(3.8) d t cp + ||V<^| 2 + g (p) = K(p)Ap + l -K'{p)\ V/f . 

Changing x into x — ct (and keeping the notation x) to make the wave stationary, linearizing 
( 13. TJ) , (13. 8p about a solitary wave Q c = (p c ,u c ) and looking for solutions (77, <p) under the 
form 

(r^)=e CT ¥^f/(x), 
we find an eigenvalue problem under the form ( II. ip with A(k) = J~ l and 



J 

L(k) = 



1 
-1 



-d x (K(p c )d x ) + k 2 K(p c ) - m -c9 K + w c <9 x . 

cd x - d x (u c ■ ) -d x (p c d x ■ ) + p c k 2 

where the function m(x) is defined by 

™ = K>( Pc K+ 1 -K>>(p c )(p> c f-g' (p c ). 

By taking H = L 2 (IR) x L 2 (M), Z> = if 2 x H 2 , we are in the right functional framework, in 
particular, L(k) has a self-adjoint realization. Let us now check assumptions (Hl-4): 

• (HI): with U = (p, ip), we have 

(L(k)U,U)> [ (K(p c )(\d x p\ 2 + k 2 \p\ 2 )+ Pc (\dM 2 + k 2 \v\ 2 ) 
Jr v 

-0(l)(\p\(\p\ + \<p\) + \d x p\\<p\))dx 



where 0{1) is independent of k. Since K(p c ) > a > 0, we get by using the Young 
inequality: 

(3.9) ab < 5 -a 2 + -U 2 , a, 6 > 0, 5 > 0, 

2 2o 

that (HI) is verified for k sufficiently large. 

• (H2) By standard arguments (see [T3], for example), to locate the essential spectrum 
of L(k), we have to study the spectrum of 

L (k) = ( ( K (p°°)(~ 9 ™ + k2 ) + 9o(poo) -cd x + u OQ d x \ 
V cd x -u oo x poo ( - d xx + k 2 ) )' 

By using the Fourier transform, we can compute explicitly the spectrum of this 
operator, we find that p is in the spectrum of L^ik) if and only if there exists £ such 
that 

p 2 -s(^k)p + p(^k) =0 

with 

s = (K( Poo ) + Poo )(k 2 + e 2 ) + g' Q (Poo), 

p = p 00 K(p 00 )(k 2 + £ 2 ) 2 + Poog' (Poo)k 2 + (poofl'o(Poo) - («oo - c) 2 )^ 2 > 0. 



By using that and K(poo) are positive and the condition (I3.6p . we get that the 
two roots are nonnegative for all k and strictly positive for k ^ 0. This proves that 
(H2) is matched. 

(H3) We have 

Consequently, (H3) is verified since p c and K(p c ) are positive. 

(H4) We shall use the following algebraic lemma: 

Lemma 3.1. Consider a symmetric operator on H under the form 

L = 

with L 2 invertible. Then we have 

(LU,U) = ((in-AL^A^UuU^ + (l 2 {U 2 + L 2 1 A*U 1 ), U 2 + L^A*uX 

The proof is a direct calculation. Note that the above lemma remains true as soon 
as the quadratic form in the right-hand side makes sense (and hence even if L^ 1 is 
not well-defined.) 

Let us apply this lemma to L(0). We see that with 

A = (u c - c)d x , L 2 = -d x (p c d x ), 
if u G H 2 solves the equation L 2 u = —A*U\, then 



L x A 

A* L 2 



Consequently, we get 



d x u = — -(u c - c)Ui. 

Pc 



(Ur ~ C? 



AL; 1 A*XJ x = (u c - c)d x u = ^ '-U x 

Pc 

and hence we have the following factorization: 



2 

dx 



(3.10) (L(0)U, U) = (MU lt U,) + [ Pc d x U 2 + — (n c - c)U x 

JR Pc 

where 

(u - c) 2 

MUt = -d^KfafaUi) -mU x - ^ >-U x . 

Pc 

Note that M is a second order differential operator and that by using the profile 
equation satisfied by Q c , we can check that p' c is in the kernel of M. Since p' c has 
a unique zero, this proves that M has exactly one negative eigenvalue with corre- 
sponding eigenfunction R. From the condition (13.61) . we also get that the essential 
spectrum of M is included in [a, +oo) for some a > 0. In particular (since M is 
self-adjoint), we get that 



(3.11) (MU^Ux) > 0, VUie(R) 
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We can now use these properties of M to prove that (H4) is matched. We can first 
get from (I3.10P that L(0) has indeed one negative direction. A first try would be to 
take U\ = R and 

d x U2 = (u c — c)R. 

Pc 

The problem is that this equation does not have a solution in L 2 . Nevertheless, we 
can get the result by using an approximation argument. Indeed, again by cutting the 
low frequencies, we can choose a sequence C/J G H 2 such that 

d x U^--(u c -c)R 

Pc 

in H 2 . Then since (MR, R) < 0, we get that (L(0)t/ n , U n ) < 0, with U n = (R,Ug), 
for n sufficiently large and hence by the variational characterization of the smallest 
eigenvalue, we get that L(0) has a negative eigenvalue. From (I3.10P and (13. lip , we 
then get that this negative eigenvalue is unique. This proves that (H4) is verified. 

Consequently, we can use Theorem II. II to get the instability of the solitary wave. We have 
thus proven: 

Theorem 3.2. If a solitary wave satisfies the condition (I3.6p . then it is unstable with respect 
to transverse perturbations. 

Note that a similar result has been obtained in [3] by using an Evans function calculation. 

3.3. Travelling waves of the Gross-Pitaevskii equation. In this subsection, we consider 
the Gross-Pitaevskii equation which is a standard model for Bose-Einstein condensates, 

(3.12) z^ + ^ + ^(l-|^| 2 ) = 

where the unknown ip is complex- valued. This equation has well-known explicit one-dimensional 
travelling waves (the so-called dark solitary waves) whose modulus tend to 1 at infinity, for 
every c < 1 they read : 

(3.13) ij}(t, x, y) = ^ c ( z ) = Vl — c 2 tanh (zVl — c 2 )) + ic, z = x — ct. 

In the case of the standard solitary waves of the cubic focusing Schrodinger equation, their 
transverse instability which was shown by Zakharov and Rubenchik can be studied by a 
standard bifurcation argument since is not in the essential spectrum of the linearized 
operator, we refer for example to [21] for the details. This is not the case for the dark 
solitary waves, is in the essential spectrum of the linearized operator, we shall thus use the 
criterion given by Theorem 11.11 

Note that for c ^ 0, \l/ c does not vanish. Consequently, we can study the stability of these 
waves (travelling bubbles) by using the Madelung transform, i.e. by seeking solutions of 
(I3.12p under the form 

with smooth p and <p. We then classically find that (p, u = Vy?) is a solution of (13. 3p . (13 .4p 
with: 

9o(p) = P ~ 1, K (p) = t- 



The dark solitary waves for becomes a solitary wave (p c ,u c ) of (13.31) . f!3.4[) with 



p c ( z ) = c 2 + (1 - c 2 )tanh 2 (zVl -c 2 )), 
Uc (^) = - C(1 ~ c2) (l - tanh 2 (zVT^d 2 ) 

Pc * 

In particular, we thus have = 1 and = 0. Since g' Q (p) = 1, the condition (13.61) 
reduces to c 2 < 1. Consequently, we have by Theorem 13.21 that all the dark solitary waves 
with |c| < 1, c ^ are unstable with respect to transverse perturbation. Note that the 
one-dimensional stability of these travelling bubbles was shown in [T7] . 

It remains to study the case c = 0. Note that \l/o is a stationary solution, the so-called 
black soliton, which has the very simple expression 

^o(x) = tanh (x). 

Its one dimensional orbital stability has been shown in [TO], [S]. Here we shall prove that 
it becomes transversally unstable by using Theorem 11.11 Since the Madelung transform 
is not appropriate (the solitary wave vanishes at the origin) we shall work directly on the 
formulation (I3.12p . 

Linearizing (13 . 1 2[) about ^/q, splitting real and imaginary parts and seeking solutions under 
the form (jl.4p yield a problem under the form (II. ip with A(k) = J -1 and 

( 1\ ( I(-0 M + fc 2 ) + 3*8-1 \ 

J -\-io)' L ^-{ o \{-d xx + k 2 )-{i-^ 2 ) )■ 

Again, with H = L 2 x L 2 and V = H 2 x H 2 , we can check (Hl-4). 

(HI) and (H3) are obviously matched. Thanks to the decay of the solitary wave, we have 
that L(k) is a compact perturbation of 



±(-d xx + k 2 ) + 2 

\{-d xx + k 2 ) 



and hence, a simple computation shows that (H2) is also matched. Finally, we can also easily 
check (H4). Let us set L(0) = diag (Li,L 2 ). We first notice that 

£1*0 = 0, L 2 * = 0. 

and that the essential spectrum of L\ is contained in [2, +00) and the one of L 2 in [0, +00). 
Since *q does not vanish and *o vanishes only once, we get by Sturm-Liouville theory that 
is the first eigenvalue of L\ and that L 2 has a unique negative eigenvalue. This proves that 
(H4) is matched. 

Consequently, we get from Theorem 11.11 that the black soliton *o is transversally unstable. 
We have thus proven: 

Theorem 3.3. For every c, \c\ < 1, the dark solitary waves (I3.13P are transversally unstable. 

Remark 3.4. Using arguments as above, we can also prove the transverse instability of 
the one dimensional localized solitary waves of the nonlinear Schrddinger equation and thus 
obtain another proof of the classical Zakharov-Rubenchik instability result. 
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Remark 3.5. The most difficult assumption to check is often the assumption (HJf.). Note 
that on the above examples this is always a direct consequence of Sturm- Liouville theory 
which is an ODE result. In the above examples, the eigenvalue problem for L(0) is already 
itself an ODE. Nevertheless, for the capillary- gravity solitary waves problem studied in [23], 
there is a nonlocal operator arising in the definition of L(0) and hence the eigenvalue problem 
for L(0) cannot be formulated as an ODE. Nevertheless, it was proven by Mielke [TS] that 
(H4) is matched since in the KdV limit the spectral properties of L(0) are the same as the 
ones of the linearized KdV hamiltonian about the KdV solitary wave which are known (again 
thanks to Sturm Liouville theory). 
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